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Abstract — We consider a relay channel for which the following as- 
sumptions are made : 1. Tlie source-destination and relay-destination 
channels are orthogonal (frequency division relay channel) ; 2. The 
relay implements the decode-and-forward protocol ; 3. The source 
and relay implement the same channel encoder namely a convo- 
lutional encoder ; 4. They can use arbitrary and possibly different 
modulations. In this framework, we derive the best combiner in the 
sense of the maximum likelihood (ML) at the destination and the 
branch metrics of the trellis associated with its channel decoder for 
the ML combiner and also for the maximum ratio combiner (MRC), 
Cooperative-MRC (C-MRC) and the minimum mean square error 
(MMSE) combiner. 

I. Motivations and technical background 

We consider orthogonal relay ciiannels for which orthogonality 
is implemented in frequency [1]. Since the source-destination 
channel is assumed to be orthogonal to the relay-destination 
channel the destination receives two distinct signals. In order to 
maintain the receiver complexity at a low level, the destination is 
imposed to combine the received signals before applying channel 
decoding. The relay is assumed to implement the decode-and- 
forward (DF) protocol. We have at least two motivations for 
this choice. First, in contrast with the well-known amplify-and- 
forward (AF) protocol, it can be implemented in a digital relay 
transceiver. More importantly, whereas the AF protocol imposes 
the source-relay channel to have the same bandwidth as the 
relay-destination channel, the DF protocol offers some degrees 
of freedom in this respect. This is a critical point when the 
cooperative network has to be designed from the association of 
two existing networks. For instance, if one wants to increase 
the performance of a Digital Video Broadcasting (DVB) receiver 
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or reach some uncovered indoor areas, a possible solution is 
to use cell phones, say Universal Mobile Telecommunications 
System (UMTS) cell phones as relaying nodes. The problem 
is that DVB signals use a 20 MHz bandwidth (source-relay 
channel) while UMTS signals have only a bandwidth of 5 MHz 
(relay-destination channel). The AF protocol cannot be used here. 
But the DF protocol can be used, for instance, by adapting the 
modulation of the cooperative signal to the available bandwidth. 
In this case, the destination has to combine two signals with 
different modulations. 

In this context, one of the issues that needs to be addressed 
is the design of the combiner. A conventional MRC cannot be 
used for combining signals with different modulations (except 
for special cases of modulations). Even if the modulations at the 
source and relay are identical, the MRC can severely degrade 
the receiver performance because it does not compensate for 
the decoding noise introduced by the relay [2]-[6]. This is why 
the authors of [2] [4] proposed a maximum likelihood detector 
(MLD) for combining two BPSK-modulated signals coming from 
the source and relay. The authors of [6] proposed an improved 
MRC called C-MRC which aims at maximizing receive diversity. 
The authors of [3] proposed a linear combiner for which the 
weights are tuned to minimize the raw bit error rate (BER). The 
main issue is that one is not always able to explicit the raw BER 
as a function of the combiner weights whereas the likelihood 
calculation is more systematic. Additionally, when some a priori 
knowledge is available, the ML metric can be used to calculate 
an a posteriori probability (APP). In the context of orthogonal 
A'^— relay channels the authors of [4] derived two new combiners : 
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the best MRC in the sense of the equivalent signal-to-noise ratio 
and MMSE combiner. They also assessed the BER performance 
of the latter and MLD in the uncoded case. 

Compared to the aforementioned works, this paper also aims 
at designing a good combiner at the destination but it differs 
from them on two essential points : 1. The interaction between 
the combiner and channel decoder is exploited in the sense that 
we want to express the branch metrics of the trellis associated 
with channel decoding for the MRC, MMSE combiner, C-MRC 
and especially for the ML combiner ; 2. When the ML combiner 
is assumed, the source and relay can use arbitrary modulations 
(not necessarily BPSK modulations as in [2] [3] [5]) and, more 
importantly, these can be different. 

II. Signal MODEL 

At the source the L-information bit sequence m is encoded 
into a sequence of bits b and modulated into the transmitted si- 
gnal X = {x{l), x{T)) where, G {1, T}, x(t) e X,X 
is a finite alphabet corresponding to the modulation constellation 
used by the source and E |a::(t)|^ < Po- At the relay the message 
is decoded, re-encoded with the same encoder as the source and 
modulated into the transmitted signal x-^ = (a;i(l), a;i(ri)) 
where, Vfi G {1, ...,Ti}, xi{ti) G Xi, X\ is a finite alphabet 
corresponding to the modulation constellation used by the relay 
and Ej2;i(ti)|^ < Pi. We denote by s (resp. r) the number 
of coded bits conveyed by one source (resp. relay) symbol. By 
definition : s = logj \X\ and r = logj \X\\. More specifically, 
the information bit sequence is assumed to be encoded by a 
i-rate convolutional encoder (g G N*). As the sequence x_ 
comprises T symbols we have that g(fc + !/) = sT where f is the 
channel encoder memory. Assuming time selective but frequency 
non-selective channels, the baseband signals received by the 
destination from the source and relay respectively write yo{t) — 
hox{t) + zo{t) and yi(fi) — hixi{ti) + zi(fi) where zo and 
Zi are zero-mean circularly symmetric complex Gaussian noises 
with variances ctq and af respectively. The complex coefficients 
ho and hi represent the gains of the source-destination and 
source-relay fading channels. For insuring coherent decoding, 
these two gains are assumed to be known to the receiver and 

relay respectively. We define 70 = E |/io|^ 71 = Klhif 

2 e\x X'\ / ''^ 

7i = E /ii -Er and pi — — — p — - where hi is the gain of 

the source-relay fading channel. Note that, in order to ensure 

the conservation of the coded bit rate between the input and 
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output of the relay, s and r have to be linked by the following 
compatibility relation : sT — rTi. In the sequel we will use the 
quantity k = lcm(s, r) (where 1cm is the least common multiple 
function). For simplicity, we assume that the source and relay 
use the same channel coder. Therefore the relay has to use a 
modulation that is compatible with the source's one. We will 
also assume that the number of times per second the channel 
can be used is directly proportional to the available bandwidth. 
For example, if the source uses a BPSK modulation and the 
cooperation channel has a bandwidth equal to half the downlink 
bandwidth, the relay can use a QPSK modulation. 

III. A NEW TRELLIS BRANCH METRIC 

A. When the source and relay use arbitrary and different modu- 
lations 

In this case, the linear combiners derived by [3] [4] [6] cannot 
be used in general. However, provided that the above compati- 
bility condition is met, the ML combiner can be derived as we 
show now. Let us denote by and the sequences of noisy 
symbols received by the destination from the source and relay 
respectively. The discrete optimization problem the ML combiner 
solves is as follows ; 

m = arg max pml = arg maxp (y,,,y^ \x) . 

As the reception noises are assumed to be independent, 'Pml ~ 
P ^J/q I^) P (^y^ Is) ■ The first term easily writes as 

In order to express the second term, we introduce a sequence of 
Ti discrete symbols denoted by e-^ which models the residual 
noise at the relay after the decoding-re-encoding process. This 
noise is therefore modeled by a multiplicative error term which 
is not independent of the symbols transmitted by the relay. 
Additionally, the statistics of this noise are assumed to be known 
by the destination. For this, one can establish once and for all a 
lookup table between the source-relay SNR and the bit error rate 
after re-encoding at the relay. The cooperation signal writes then 
as yi{ti) = hixi{ti) + zi{ti) where xi{ti) = ej(ti)5i(ti) 
and xi{ti) is the symbol the relay would generate if there were 
no decoding error at the relay. For example, when the relay 
uses a QPSK modulation, ei G {l,e-''2,e-''^,e-'~}. Therefore 
we have that P Js) = P (yjii) = ^P (y_^, e^i^ = 
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(gi ISi) P (jJ^llLuS.!^ ■ At this point, we need to make an 
additional assumption in order to easily derive the path metric 
of the ML decoder. From now one, we assume that the discrete 
symbols of the sequence are conditionally independent. This 
assumption is very realistic, for example, if the source and 
relay implement a bit interleaved coded modulation (BICM) or 
a trellis coded modulation (TCM). In the case of the BICM, the 
channel coder, which generates coded bits, and the modulator 
are separated by an interleaver. The presence of this interleaver 
precisely makes the proposed assumption reasonable. Under the 
aforementioned assumption one can expand p ^j/^ as 

p(yik) = Y1 n P(ei(*i)l*i(*i))p(yi(*i)l*i(*i).ei(ii)) 

Ti 
S.1 *1 = 1 

1 ^ gxp ( li/l(tl)-feiei(tl)5il(tl)P A 

The main consequence of this assumption is a significant reduc- 
tion of the decoder complexity. If the assumption is not valid, 
the proposed derivation can always be used but the performance 
gain obtained can be marginal since the en'ors produced by will 
not be spread over the data block but rather occurs in a sporadic 
manner along the block. 

In order to express the path metric of a given path in the 
trellis associated with channel decoding, we need now to link the 
likelihood expressed above and the likelihood associated with a 
given bit bj, where j £ {1, ...,k}. The reason why we consider 
sub-blocks of k bits is that, in order to meet the rate compatibility 
condition, the ML combiner combines the fcs = 7 symbols 
received from the source with the kr = ^ symbols received from 
the relay. Now, G {0, 1} x {1, k}, let us define the sets 

^I'^'O) = = (bi,-, bk) G {0, l}^ bj = i}, a set of sub- 
blocks of rs consecutive bits, <-f/''°'(j) — {x''^ £ X''" , bj = i} 
and Xj^\''\j) = {x'l'' G X^'' , bj = i}, their equivalents in the 
source (resp. relay) modulation space. With these notations the 
bit likelihood can be expressed as follows 

A (6, = ^) = In [ ^ p (y^^;^ ) p (yf,-, \x1:,) ] 

where we used the notation = {v{l), ...,v{n)). When a 
BICM is used, the obtained log-likelihood sequence is then de- 
interleaved and given to a Viterbi decoder. 
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B. When the source and relay use arbitrary and identical mo- 
dulations 

The derivation of the coded-bit likelihood in the case where 
the modulations used by the source and relay are the same 
is ready since it is special case of derivation conducted pre- 
viously with fc = s = r. In this case, both ML and linear 
combiners can be used since the combination can be performed 
symbol-by-symbol. The log-likelihood becomes \{bj—i) = 



In 



J2 p{yo{t)\x{t))p{y^{t)\x{t)) 



"f we further assume that the modulations used are BPSK 



where 1 < j < 



modulations, the likelihood on the received sequences take a 
more explicit form. Indeed, it can be checked that 

In [p (y„,yjm)] = 

T 

-kq In {2tt) -Tin {aoa^) - ^ 



\yo{t) - hox{t)[ 



-In 



Pr [e(t) = e] exp ( - 



\yi(t) - hiex{t)\'' 



where Pr[e = — 1] represents the residual bit error rate (after 
the decoding-re-encoding procedure inherent to DF protocol). 
Denote by n the interleaver function such that t — n (to) and 
to = TT~^ (t). Finally, the path metric is merely given by 

\yo{to) - hox{to)\ 



In 



E 



Pr (e(to) = e)exp 

e=-l, + l 



\yi{to) - hiex{to)\" 



So the combining and channel decoding are performed jointly 
by modifying the branch metrics as indicated above. 
When using a linear combiner, one has to compute the APP 
from the equivalent signal at the combiner output. This com- 
putation requires the equivalent channel gain and noise. We 
provide them for each linear combiner considered here. For 
a given combiner, denote its optimal vector of weights by 

w_ — {wo,wi) and rewrite the signal at the combiner output as 

1 



E 



Wiyi 



are the equivalent channel gain and noise respectively. The bit 
log-likelihood can then be easily expressed as A {bj — i) = 
In [ p{y I heq,x_)]. Table U] summarizes the values of 

these quantities with the notations ao — \hof and ai — 

IV. Simulation EXAMPLE 

For the 2 figures provided, we assume that the source and 
the relay implement a i— rate convolutional encoder (4— state 
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MRC 




an _,_ ai 


MMSE 


ao 1 11 Pi 




ctJ o-2+aiPo(a?-P?) 




C-MRC 


min{7[,7i} 

ao + ^'^ ax 


o 1 min{7T ,71 } o 



TABLE I 

Equivalent channel parameters for the linear combiners 

encoder with a free distance equal to 5). Frequency non-selective 
Rayleigh block fading channels are assumed and the data block 
length is chosen to be 1024. First, we compare the combiners 
between themselves when both the relay and source use a 
4— QAM modulation. Fig. [T] represents the BER at the decoder 
output as a function of 70 = 7i. There are 6 curves. From the top 
to the bottom, they respectively represent the performance with 
no relay, with the relay associated with the conventional MRC, 
MMSE, C-MRC and ML combiners. When implementing the 
conventional MRC, the receiver does not significantly improve 
its performance w.r.t. to the non cooperative case whereas the 
other combiners can provide more than a 8 dB gain and perform 
quite similarly. Then (see Fig. |2ll, we evaluate the performance 
gain brought by the MLD when the source and relay have to use 
different modulations : the source implements a BPSK while 
the relay implements either a 4— QAM or a 16— QAM. The 
second scenario would conespond to a case where the source- 
destination channel bandwidth is 4 times larger than the source- 
destination channel bandwidth (e.g. 20 MHz vs 5 MHz). We 
see that the MLD not only makes cooperation possible but also 
allows the destination to extract a significant performance gain 
from it. To have an additional reference, we also represented the 
performance of the equivalent virtual 1x2 MIMO system, which 
is obtained for 71 = +00. 

V. Concluding remarks 

The results provided in this letter and many other simulations 
performed in the coded case led us to the following conclusion : 
if the source and relay can use the same modulation, the C-MRC 
generally offers the best performance-complexity trade-off. On 
the other hand, if the modulations are different, as it would be 
generally the case when two existing communications systems 
are associated to cooperate, linear combiners and thus the C- 
MRC cannot be used in general and the ML combiner is the 
only implementable combiner. 
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Fig. 1. BER at the destination with 7^ = 70, 71 = 70 
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Fig. 2. BER at the destination 7^ = 70, 71 = 70 — 10 dB 
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